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HyperVideo Tracking and Reporting System 



Field of the Invention 

The invention relates generally to a hypervideo system incorporating hot links 
within a video presentation, and more specifically to a hypervideo tracking and 
reporting system. 

Incorporation of Related Matters 

This application hereby incorporates by reference related pending U.S. patent 
applications 09/200,146, filed 11/25/1998 , titled "Streaming Hypervideo and 
Dynamic Hypervideo"; and 08/882,512, filed 06/25/97, titled "System and Method for 
Linking Information to and Accessing Information From a Video". 

Claim of Priority 

This application claims priority from U.S. provisional application 60/167,165, 
filed 11/23/99, titled "Hypervideo Suite". 

Background of the Invention 

As personal computers and access to the Internet have become increasingly 
common, computers have become more widely relied upon for communication. 
Businesses provide product information, customer support, and ordering capability via 
the Internet, e-mail is widely used for personal and business communication via the 
Internet in place of telephone or postal mail, and discussions relating to a wide variety 



of specific topics are conducted in Internet-based discussion groups. As technology 
and access to the Internet continue to increase, it is reasonable to expect that 
communication via the Internet will continue to increase in popularity and the methods 
in which the Internet is used to communicate will continue to expand. 
5 Web pages or websites comprising a part of the World Wide Web (WWW) are 

perhaps the most common means of posting information for mass viewing or for 
providing services such as e-commerce ability to the public at large. Web pages are 
defined via a markup language that can be transmitted via the Internet to website users, 
who run web browser applications that interpret the markup language information and 

10 render web pages on the user computer systems. Markup languages such as HTML 
allow presentation of text, graphics, menus, tables, and other useful structures to users 
via the Internet connections that link web page servers and user client systems running 
web browser applications. One common feature incorporated into web pages is known 
as a "Hyperlink", which is typically text or a graphic representing other content, that 

15 when clicked on using a mouse cursor or otherwise selected loads and presents the 
represented other content. 

But, as bandwidth and computational power in computerized systems continue 
to increase, the types of information presented via the World Wide Web and other 
sources continues to advance. Now, it is not uncommon to find relatively large and 

20 complex streaming audio or video broadcasts of content in addition to more traditional 
text and still image content, and such content continues to become more common. 
However, content such as video has typically been presented as a stand-alone 
presentation, without incorporating links to other content. 



The concept of Hypervideo seeks to provide this hyperlink-type functionality 
to video presentations, enabling linking and retrieval of information related to objects 
or images presented in a video presentation. For example, a user watching a football 
game may move a cursor over a player and click on the player's image to see statistics 
5 on that player, or may similarly select a product in a commercial or television show for 
more information on the product. 

Hypervideo capability is currently provided via a proprietary hypervideo 
software system called Hypervideo Suite. This software provides a multimedia 
designer the tools to create video with hyperlinks, such as may be viewable over the 

10 Internet or other broadband network using a hypervideo player or other media viewer. 
Incorporation of hyperlinks into video using Hypervideo Suite technology is hoped to 
become the preferred method of providing hyperlinks in video content as broadband 
network access becomes commonplace. 

But, along with tools to facilitate providing hypervideo content, it is desirable 

15 to track the use of such content. Because such content remains relatively expensive to 
produce and distribute, evaluation of commercial effectiveness of hypervideo content 
for various applications is key to cost-effective or profitable use of hypevideo. 
Tracking use of content can serve a variety of other functions, such as tracking 
progress of training or educational material. While web servers often provide statistics 

20 on the number of times selected elements have been downloaded and other such 
information, they do not track a user's progress through a series of links where the 
links include clicking through hotspots or links in video, or provide other information 
key to understanding how content is used, 

3 



What is needed is a system that is capable of tracking and reporting user 
behavior in a Hypervideo system. 

Summary of the Invention 

5 The present invention facilitates tracking and reporting of user behavior in a 

hypervideo system. The system provides tracking and recording of media viewed by a 
user, where media comprises hypervideo video-enhanced pages and other media types. 
The system is operable to create a user-configurable report, comprising data regarding 
user use of the media, such as indicating the number of times each media has been 

1 0 viewed and indicating the number of times each path has been taken through each 
hypervideo application. 

Brief Description of the Figures 

Figure 1 is a computer screen image of a hypervideo application report, 
1 5 consistent with an embodiment of the present invention. 

Figure 2 is a table illustrating application executions for each application 
sorted by day of the week the execution occurred, consistent with an embodiment of 
the present invention. 

Figure 3 illustrates a computer screen image that represents a video-enhanced 
20 page report generated consistent with an embodiment of the present invention. 

Figure 4 illustrates a report indicating the media path taken through each 
application, consistent with an embodiment of the present invention. 

Figure 5 shows a path detail report screen image, consistent with an 

4 



embodiment of the present invention. 

Figure 6 is a screen image of a hotspot report ^consistent with an embodiment 
of the present invention. 

Figure 7 is a screen image of an advertising media hotspot report,consistent 
with an embodiment of the present invention. 

Detailed Description 

In the following detailed description of sample embodiments of the invention, 
reference is made to the accompanying drawings which form a part hereof, and in 
which is shown by way of illustration specific sample embodiments in which the 
invention may be practiced. These embodiments are described in sufficient detail to 
enable those skilled in the art to practice the invention, and it is to be understood that 
other embodiments may be utilized and that logical, mechanical, electrical, and other 
changes may be made without departing from the spirit or scope of the present 
invention. The following detailed description is, therefore, not to be taken in a limiting 
sense, and the scope of the invention is defined only by the appended claims. 

The present invention provides in various embodiments a system facilitating 
tracking and reporting of user actions in a hypervideo system. The system provides 
tracking and recording media viewed by a user, where media comprises hypervideo 
video-enhanced pages (VEPs) and other media types. The system is operable to create 
a user-configurable report, indicating data relating to user access of the media such as 
the number of times each media has been viewed and the number of times each path 
has been taken through each hypervideo application. 



Hypervideo is a system enabling linking information to and accessing 
information from a video. Hypervideo contains one or more regions of interest, or 
hotspots, where each hotspot is linked to one or more targets. Hypervideo permits a 
user to interact with video, by selecting hotspots to retrieve selected information or 

5 perform other actions associated with the image the hotspot represents. The user can 
navigate hypervideo from any base such as HTML, an image, video, or other media 
types, and may similarly retrieve from within hypervideo any type of media. The 
media targets viewed from within hypervideo may be viewed or executed serially, 
simultaneously, or in any other manner. 

10 An authoring tool is used to create hotspots within video to create hypervideo 

appplications by defining regions of interest and associating those regions with other 
media content. The hotspot similarly may be defined in a picture, such as a bitmap 
graphic image. The hotspot may then be selected by a user, such as by placing a 
mouse cursor over the hotspot and clicking the mouse. Upon activation, the linked 

1 5 media associated with the hotspot is viewed or executed. Multiple media may be 
linked to a hotspot in some embodiments of the invention, so that selecting or 
actuating a hotspot retrieves or executes one or more different linked media. 

Hypervideo media hotspots and media content may be initiated via user 
selection such as by mouse click, may be actuated via automatic activation such as an 

20 API call in a Javascript program, or in any other way in various embodiments of 
hypervideo systems. 

Hypervideo in one embodiment of the invention will be provided to a user via 
a server providing content over a broadband network, and the users of hypervideo will 



view hypervideo content using hypervideo content viewer applications or hypervideo 
viewer plugin applications within standard web browsers. Other embodiments may 
include delivery of hypervideo content via machine-readable mediums such as CDs, or 
via any other method of delivering content to a user. The hypervideo content may also 

5 be viewed in some embodiments using standard viewers, rather than dedicated or 
proprietary hypervideo viewers. 

Hypervideo will be useful in a variety of applications, such as interactive 
television, games, toruism information, and home shopping. It is anticipated that due 
to the flexibility of the hypervideo system, a variety of other applications exist and 

10 will be developed, all of which are consistent with and within the scope of the present 
invention. 

A hypervideo application provides a tree of media that includes video- 
enhanced pages, where video-enhanced pages are pages of content that are displayed 
or otherwise presented to a user. For example, video, images, audio, or HTML pages 

1 5 may be video-enhanced pages, if they are pages that form a part of the sequence of 
content displayed by the hypervideo application. The video-enhanced page (VEP) is 
further defined as the hypervideo application executes as only that content that is 
currently being displayed in the front or current level of the application. In some 
embodiments of the invention, when more than one element of content or media are 

20 displayed at a time, the VEP is the content type that has the highest priority or that is 
displayed as a larger representation. Content types are ordered in one such 
embodiment so that video is the highest priority, followed sequentially by images, 
audio, and HTML pages. 



Tracking and reporting of hypervideo content is acomplished via a novel 
tracking and reporting system. When a user requests a hypervideo VEP or media, the 
request is logged and the time the VEP is viewed is recorded. The logged information 
may be automatically analyzed to create performance statistics, to alter the operation 

5 of the server, or to perform other functions, but is also available to a reporting tool that 
is operable to peform functions such as reporting and summarizing information about 
the hypervideo media. 

One example of a hypervideo application report is shown in Figure 1. The 
screen image of Figure 1 shows the applications listed at 101, and shows for each 

1 0 application displayed the number of user sessions during which the application was 
executed at 102. At 103, the number of unique users to have viewed each application 
is displayed, and the average time each user spends within each application is shown at 
104. In some further embodiments of the invention, some or all of this information is 
presented graphically, as is shown at 105. 

1 5 This information is also viewable sorted by time of day, day of the week, or 

other criteria as is shown in Figure 2. Figure 2 shows generally a table illustrating an 
example embodiment of the present invention in which application executions are 
listed by day of the week, which may allow a hypervideo system provider to better 
understand demand and use of the hypervideo media content provided. 

20 Figure 3 illustrates a computer screen image that represents a video-enhanced 

page (VEP) report generated consistent with the present invention. Each video 
enhanced page listed in the table is represented both by an icon indicating the media 
type at 301, and a name at 302. Ideally, the name will be descriptive of the content of 



the media, to facilitate user interpretation of the report. At 303, the number of views 
of each media (including VEP) listed in the report is shown, and the number of user 
sessions during which each media was viewed is listed at 304. At 305, the report table 
indicates the number of unique users to have viewed each media, and the average time 
that users view each listed media is shown at 306. Media other than VEP media are 
included in the embodiment of the invention shown in Figure 3 for a variety of 
reasons, including representation of media viewed while not in the front or current 
position as is required in some embodiments for media to be considered a VEP. 

The user may configure the report tool in some embodiments of the invention 
to report data for only selected types of media, to display statistics for only certain 
dates, or to otherwise select the type of data presented in a report. For example, a user 
may wish to view data starting at the first day of the current month for VEP media 
only, and may create a custom report including only such data. 

In a further embodiment of the invention, the number of times each media has 
been viewed as shown at 303 of Figure 3 does not include returning to a media in a 
single session where the media path brings a user back to a media. In this manner, 
double- viewing of media that causes a user to view other content and then return does 
not skew the statistics presented in the report. 

The report may also be limited in some embodiments to showing statistics for 
only a selected number of top or bottom-ranked applications. For example, a report 
may be limited to the most frequently viewed 20 applications on a server. This 
flexibility allows the user to further customize reports and derive additional 
information from the reporting tool. 



For looping media such as video or audio, the number of total views and the 
number of distinct views not resulting from looping may be indicated, so that the 
number of views reported is not distorted by the looping process. For example, a 
video viewed 120 times total but only 40 times in distinct views not a result of looping 

5 indicates that the video looped three times on average each time it was played. 

The statistics screen may further indicate in select embodiments of the 
invention the reason for the media start or presentation. For example, an automatic 
start from an application, a hotframe, or an end-of-media triggered start may be 
reported individually or as automatic starts, and hotlinks, API calls, and hotspot 

10 activations may be reported separately or as user-triggered starts. This information 
may be summarized or otherwise characterized such as by icon in further 
embodiments of the invention. 

Figure 4 illustrates a report indicating the media path taken through each 
application, listed in order of the total number of user executions of each application 

1 5 following each path displayed. A path is defined in the embodiment of the invention 
illustrated in Figure 4 as the page flow of the application from start to end of a user 
session, including VEPs and other media. The number of user sessions per application 
path is shown at 401, and the number of unique users following each application path 
is shown at 402. At 403, the percentage of total application executions that took each 

20 path is listed, indicating which paths through the application are most common. The 
average amount of total time spent taking each path is listed at 405. 

The report shown in Figure 4 is in some embodiments user-configurable to 
include or present data in a way the user desires. For example, a minimum path length 



may be defined by the user, so that paths taken through an application not meeting or 
exceeding the minimum number of media or VEPs viewed will not be displayed in the 
report. Also, paths that are not entirely identical may be grouped together for 
reporting purposes if the have selected path segments in common. In such an 
5 embodiment, a user may choose to group all paths that have the first five elements in 
common, or may choose to group paths that have some other selected segment in 
common, so that they will be aggregated and single path statistics will be displayed for 
each group. 

As is shown at 405, the path taken through an application may be represented 
1 0 by icons representing each media or VEP in the path. In alternate embodiments, 

media names, icons, or other methods may be employed to uniquely identify each path 
within the report. Icons may be used in some embodiments of the invention to 
visually represent additional data, such as what triggered a hotspot activation, different 
media types, or other data. 
15 A path report is provided in some embodiments of the invention, as is shown at 

Figure 5. The path report shown in Figure 5 shows only VEPs, but the invention in 
alternate embodiments also includes other media. The report shows at 501 a list of 
media contained in a currently-displayed VEP, and the hotspots on each media. Data 
regarding previous VEPs which led to the current VEP is shown generally at 520, and 
20 data relating to the VEPs selecte from the current VEP is shown generally at 530. The 
links from the various hotspots in the currently-displayed VEP or media to other VEP 
or media 503 are shown at 502, along with various statistics regarding the frequency 
and time users progress from the current media to each of the next linked media. The 



average time a user spends after progressing to each of the next media is shown in 
table form at 504, and the total number of user sessions or application executions in 
which a user proceeds to each media is listed at 505. At 506, the percentage of total 
media selections attributed to each media is shown, indicating which paths are most 
5 likely to be taken. 

This path detain report therefore shows both how users arrived at the current 
VEP and the paths users took from the current VEP, ndicating paths that are effective 
and desira 

Figure 6 is a table that shows a detailed hotspot report, showing statistics for 
10 the most frequently selected hotspots in an application. In other embodiments of the 
invention, a hotspot report may comprise statistics for hotspots meeting certain use or 
date criteria, or other criteria selected by a user. The report shows statistics reflecting 
the use of each hotspot, including each hotspot name at 601, type at 602, and location 
at 603. The number of sessions or application executions in which each hotspot is 
1 5 viewed is shown at 604, and the number of movements to each hotspot via use of a 
mouse (whether the hotspot was actuated or not) is shown at 605. The number of 
times each hotspot is clicked on is shown at 606, and the percentage of viewers that 
clicked each hotspot is shown at 607. The percentage of viewers entering the hotspot- 
linked media via mouse is shown at 608, and the percentage of users entering the 
20 hotspot-linked media by clicking the mouse is shown at 609. Also, the average time 
each hotspot is viewed by a user is shown at 610. 

Overlay data is shown at 611, indicating the overlay for each listed hotspot. 
Overlays are used to mark hotspots in the media presentations, and may comprise an 



image that appears on or near a hotspot, a cursor that changes when passed over a 
hotspot, or no marking at all Other overlays are possible, such as altering the contrast 
or brightness of a hotspot or marking the hotspot in other ways, and are within the 
scope of overlays for purposes of this application. 

5 Figure 7 illustrates a special version of a hotspot media report comprising data 

only on media that is advertising media. The advertising image name and size are 
shown at 701, and the click-through URL the hotspot link links to is shown at 702. 
The number of times each advertising image was retrieved within a user session is 
shown at 703, with the number of times each image was retrieved by a unique user 

1 0 shown in parenthesis. The number of sessions in which the hotspot was clicked is 
shown at 704, and the number of unique user clicks is shown in parenthesis. At 705, 
the click-through percentage shows the percentage of user sessions that result in a 
click-through, along with the percentage of click-throughs by unique user in 
parenthesis. The average time spent viewing the advertising image is shown at 706, 

1 5 and the hotspot name is shown at 707. The media name of the media that contains the 
ad is shown at 708, which is typically video. Finally, the URL of the advertisement on 
the ad server is shown at 709. In alternate embodiments of the invention, advertising 
pages may be displayed along with other media in a media report, and may be 
individually selected for display by user-configuration of the media report. 

20 Although specific embodiments have been illustrated and described herein, it 

will be appreciated by those of ordinary skill in the art that any arrangement which is 
calculated to achieve the same purpose may be substituted for the specific 
embodiments shown. This application is intended to cover any adaptations or 

13 



variations of the invention. It is intended that this invention be limited only by the 
claims, and the full scope of equivalents thereof. 
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Claims 

1. A method of providing hypervideo application user information, comprising: 

tracking and recording media viewed by a user, where media comprises 
hypervideo applications; and 

creating a user-configurable report, the report reflecting data regarding user 
access of the media. 

2. The method of claim 1, wherein the user-configurable report comprises a report 
including data after a user-defined start date. 

3. The method of claim 1, wherein the user-configurable report comprises a report 
including data before a user-defined end date. 

4. The method of claim 1, the report data comprising the number of times each media 
has been viewed. 

5. The method of claim 1, wherein media further comprises at least one of video, 
image, HTML or audio. 

6. The method of claim 5, wherein the user configures which of the media types are to 
be included in the report. 

7. The method of claim 5, wherein each type of media is identified in the report via 

15 



representation with a unique icon. 

8. The method of claim 4, wherein the number of times each media has been viewed 
does not include returning to a media in a path in the same session. 

5 

9. The method of claim 1, wherein the number of media for which data is displayed in 
the report is selected by the user. 

10. The method of claim 1, wherein the report comprises the number of user sessions 
1 0 during which the media was viewed. 

11. The method of claim 1, wherein the report comprises the number of unique users 
to view a media. 

15 12. The method of claim 1, wherein the report comprises the average time users spent 
viewing each media. 

13. The method of claim 1, wherein the report sorts media by the number of times 
each media has been viewed. 

20 

14. The method of claim 1, wherein the number of times each media has been viewed 
comprises both the total number of times a looping video has been viewed including 
views that result from looping, and the number of times the looping video has been 

16 



viewed not as a result of looping. 

15. The method of claim 1, wherein the report comprises an indication of whether the 
views of a particular media were user-initiated or automatic. 

5 

16. The method of claim 1, wherein the report comprises an indication of whether 
video media is looping media. 

17. The method of claim 1 , the report further reflecting the number of times each path 
1 0 has been taken through each hypervideo application. 

18. The method of claim 17, wherein indicating the number of times each path has 
been taken through each hypervideo application comprises displaying data for a user- 
selected number of paths. 

15 

19. The method of claim 17, wherein indicating the number of times each path has 
been taken through each hypervideo application comprises indicating data for only 
those paths exceeding a user-defined minimum path length. 

20 20. The method of claim 17, wherein indicating the number of times each path has 
been taken through each hypervideo application comprises grouping paths together 
based on a user-defined number of same first pages in each path. 
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21 . The method of claim 1 , wherein creating a user-configurable report further 
comprises indicating for each video-enhanced page in a hypervideo application 
information regarding the previous video-enhanced pages users viewed before the 
current video-enhanced page and from which users proceeded to the current video- 

5 enhanced page, and indicating information regarding the next video-enhanced pages to 
which users proceeded from the current video-enhanced page. 

22. The method of claim 21, wherein the information regarding the previous video- 
enhanced pages comprises data regarding the identity of the previous video-enhanced 

1 0 pages viewed before and linked to the current video-enhanced page . 

23. The method of claim 21, wherein the information regarding the previous video- 
enhanced pages comprises information regarding how viewing the current video- 
enhanced page was initiated. 

15 

24. The method of claim 21, wherein the information regarding the previous video- 
enhanced pages comprises the average time users spent viewing the previous video- 
enhanced pages before proceeding to the current video-enhanced page. 

20 25. The method of claim 21, wherein the information regarding the previous video- 
enhanced pages comprises the number of user sessions for each previous video- 
enhanced page from which users have proceeded to the current video-enhanced page. 
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26. The method of claim 21 , wherein the information regarding the previous video- 
enhanced pages comprises the percentage of total times when viewing the previous 
video-enhanced pages that users proceeded to the current video-enhanced page. 

5 27. The method of claim 2 1 , wherein the information regarding the next video- 
enhanced pages comprises information about each hotspot on the current video- 
enhanced page and the next video-enhanced pages to which the hotspots are linked. 

28. The method of claim 27, wherein the information regarding the next video- 
10 enhanced pages comprises the media to which each hotspot is linked. 

29. The method of claim 27, wherein the information regarding the next video- 
enhanced pages further comprises the average time a user spends viewing the current 
video-enhanced page before progressing to each of the next video-enhanced pages. 

15 

30. The method of claim 27, wherein the information regarding the next video- 
enhanced pages further comprises the number of user sessions in which a person 
proceeds from the current video-enhanced page to each of the next video-enhanced 
pages. 

20 

3 1 . The method of claim 27, wherein the information regarding the next video- 
enhanced pages further comprises the percentage of total views of the current video- 
enhanced page that result in a user proceeding to each of the next video-enhanced 

19 



pages. 

32. The method of claim 1, the user-configurable report further comprising a hotspot 
report. 

5 

33. The method of claim 32, the hotspot report comprising the number of sessions in 
which a user has selected each hotspot. 

34. The method of claim 32, the hotspot report comprising the number of times each 
1 0 hotspot has been viewed by a user. 

35. The method of claim 32, the hotspot report comprising the average view time that 
users spent viewing the content linked to each hotspot. 

15 36. The method of claim 32, the hotspot report comprising the name and type of each 
hotspot. 

37. The method of claim 32, the hotspot report comprising the number of selections of 
each hotspot via a mouse. 

20 

38. The method of claim 32, the hotspot report comprising the percentage of viewers 
that clicked each hotspot. 
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39. The method of claim 32, the hotspot report comprising identification of the 
overlay used to represent the hotspot. 

39. A machine-readable medium with instructions stored thereon, the instructions 

5 when executed operable to cause a computer to provide hypervideo application user 
information by: 

tracking and recording media viewed by a user, where media comprises 
hypervideo applications; and 

creating a user-configurable report, the report reflecting statistical data 
10 regarding user access of the media. 

40. A machine-readable medium with instructions stored thereon, the instructions 
when executed operable to cause a computer to provide hypervideo application user 
information by: 

1 5 tracking and recording media viewed by a user, where media comprises 

hypervideo applications; and 

creating a user-configurable report, the report reflecting data regarding user 
access of the media. 

20 41. The machine-readable medium of claim 40, wherein the user-configurable report 
comprises a report including data after a user-defined start date. 

42. The machine-readable medium of claim 40, wherein the user-configurable report 

21 



comprises a report including data before a user-defined end date. 

43. The machine-readable medium of claim 40, the report data comprising the number 
of times each media has been viewed. 

5 

44. The machine-readable medium of claim 40, wherein media further comprises at 
least one of video, image, HTML or audio. 

45. The machine-readable medium of claim 44, wherein the user configures which of 
10 the media types are to be included in the report. 

46. The machine-readable medium of claim 44, wherein each type of media is 
identified in the report via representation with a unique icon, 

15 47. The machine-readable medium of claim 43, wherein the number of times each 
media has been viewed does not include returning to a media in a path in the same 
session. 

48. The machine-readable medium of claim 40, wherein the number of media for 
20 which data is displayed in the report is selected by the user. 

49. The machine-readable medium of claim 40, wherein the report comprises the 
number of user sessions during which the media was viewed. 

22 
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50. The machine-readable medium of claim 40, wherein the report comprises the 
number of unique users to view a media. 

5 1 . The machine-readable medium of claim 40, wherein the report comprises the 
5 average time users spent viewing each media. 

52. The machine-readable medium of claim 40, wherein the report sorts media by the 
number of times each media has been viewed. 

10 53 . The machine-readable medium of claim 40, wherein the number of times each 
media has been viewed comprises both the total number of times a looping video has 
been viewed including views that result from looping, and the number of times the 
looping video has been viewed not as a result of looping. 

15 54. The machine-readable medium of claim 40, wherein the report comprises an 

indication of whether the views of a particular media were user-initiated or automatic. 

55. The machine-readable medium of claim 40, wherein the report comprises an 
indication of whether video media is looping media. 

20 

56. The machine-readable medium of claim 40, the report further reflecting the 
number of times each path has been taken through each hypervideo application. 
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57. The machine-readable medium of claim 56, wherein indicating the number of 
times each path has been taken through each hypervideo application comprises 
displaying data for a user-selected number of paths. 

5 58. The machine-readable medium of claim 56, wherein indicating the number of 
times each path has been taken through each hypervideo application comprises 
indicating data for only those paths exceeding a user-defined minimum path length. 

59. The machine-readable medium of claim 56, wherein indicating the number of 
1 0 times each path has been taken through each hypervideo application comprises 

grouping paths together based on a user-defined number of same first pages in each 
path. 

60. The machine-readable medium of claim 40, wherein creating a user-configurable 
1 5 report further comprises indicating for each video-enhanced page in a hypervideo 

application information regarding the previous video-enhanced pages users viewed 
before the current video-enhanced page and from which users proceeded to the current 
video-enhanced page, and indicating information regarding the next video-enhanced 
pages to which users proceeded from the current video-enhanced page. 

20 

61 . The machine-readable medium of claim 60, wherein the information regarding the 
previous video-enhanced pages comprises data regarding the identity of the previous 
video-enhanced pages viewed before and linked to the current video-enhanced page . 

24 



62. The machine-readable medium of claim 60, wherein the information regarding the 
previous video-enhanced pages comprises information regarding how viewing the 
current video-enhanced page was initiated. 

5 63. The machine-readable medium of claim 60, wherein the information regarding the 
previous video-enhanced pages comprises the average time users spent viewing the 
previous video-enhanced pages before proceeding to the current video-enhanced page. 

64. The machine-readable medium of claim 60, wherein the information regarding the 
10 previous video-enhanced pages comprises the number of user sessions for each 

previous video-enhanced page from which users have proceeded to the current video- 
enhanced page. 

65. The machine-readable medium of claim 60, wherein the information regarding the 
1 5 previous video-enhanced pages comprises the percentage of total times when viewing 

the previous video-enhanced pages that users proceeded to the current video-enhanced 
page. 

66. The machine-readable medium of claim 60, wherein the information regarding the 
20 next video-enhanced pages comprises information about each hotspot on the current 

video-enhanced page and the next video-enhanced pages to which the hotspots are 
linked. 
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67. The machine-readable medium of claim 66, wherein the information regarding 
the next video-enhanced pages comprises the media to which each hotspot is linked. 

68. The machine-readable medium of claim 66, wherein the information regarding 
5 the next video-enhanced pages further comprises the average time a user spends 

viewing the current video-enhanced page before progressing to each of the next video- 
enhanced pages. 

69 The machine-readable medium of claim 66, wherein the information regarding the 
10 next video-enhanced pages further comprises the number of user sessions in which a 

person proceeds from the current video-enhanced page to each of the next video- 
enhanced pages. 

70 The machine-readable medium of claim 66, wherein the information regarding the 
1 5 next video-enhanced pages further comprises the percentage of total views of the 

current video-enhanced page that result in a user proceeding to each of the next video- 
enhanced pages. 

71. The machine-readable medium of claim 40, the user-configurable report further 
20 comprising a hotspot report. 

72. The machine-readable medium of claim 71, the hotspot report comprising the 
number of sessions in which a user has selected each hotspot. 
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73. The machine-readable medium of claim 71, the hotspot report comprising the 
number of times each hotspot has been viewed by a user. 

74. The machine-readable medium of claim 71, the hotspot report comprising the 
5 average view time that users spent viewing the content linked to each hotspot. 

75. The machine-readable medium of claim 71, the hotspot report comprising the 
name and type of each hotspot. 

10 

76. The machine-readable medium of claim 71, the hotspot report comprising the 
number of selections of each hotspot via a mouse. 

77. The machine-readable medium of claim 71, the hotspot report comprising the 
15 percentage of viewers that clicked each hotspot. 

78 The machine-readable medium of claim 71, the hotspot report comprising 
identification of the overlay used to represent the hotspot. 

20 79. A method of providing hypervideo application user information, comprising: 
tracking and recording media viewed by a user, where media comprises 
hypervideo applications; and 

creating a user-configurable report, the report reflecting data regarding user 

27 



viewing of advertising media via hotspots. 



80. The method of claim 79, wherein the report comprises the advertising media 
overlay image name. 

81. The method of claim 79, wherein the report comprises a click-through URL 
(Uniform Resource Locator) linked to each advertising media hotspot. 

82. The method of claim 79, wherein the report comprises the number of times each 
advertising media was retrieved within a user session. 

83. The method of claim 79, wherein the report comprises the number of times each 
advertising media was retrieved by a unique user. 

84. The method of claim 79, wherein the report comprises the percentage of times that 
a user who viewed the advertising hotspot has selected the hotspot. 

85. The method of claim 79, wherein the report comprises the average amount of time 
that users view each advertising media hotspot. 

86. A machine-readable medium with instructions thereon, the instructions when 
executed operable to cause a computer to provide hypervideo application user 
information by: 

28 



tracking and recording media viewed by a user, where media comprises 
hypervideo applications; and 

creating a user-configurable report, the report reflecting data regarding user 
viewing of advertising media via hotspots. 

5 

87. The method of claim 86, wherein the report comprises the advertising media 
overlay image name. 

88. The machine-readable medium of claim 86, wherein the report comprises a click- 
1 0 through URL (Uniform Resource Locator) linked to each advertising media hotspot. 

89. The machine-readable medium of claim 86, wherein the report comprises the 
number of times each advertising media was retrieved within a user session. 

15 90. The machine-readable medium of claim 86, wherein the report comprises the 
number of times each advertising media was retrieved by a unique user. 

91. The machine-readable medium of claim 86, wherein the report comprises the 
percentage of times that a user who viewed the advertising hotspot has selected the 
20 hotspot. 



92. The machine-readable medium of claim 86, wherein the report comprises the 
average amount of time that users view each advertising media hotspot. 
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Abstract 

The present invention facilitates tracking and reporting of user behavior in a 
hypervideo system. The system provides tracking and recording of media viewed by a 
user, where media comprises hypervideo video-enhanced pages and other media types. 
The system is operable to create a user-configurable report, comprising data regarding 
user use of the media, such as indicating the number of times each media has been 
viewed and indicating the number of times each path has been taken through each 
hypervideo application. 
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Attorney Docket No. 537.017US1 

SCHWEGMAN ■ LUNDBERG ■ WOESSNER ■ KLUTH 

United States Patent Application 

COMBINED DECLARATION AND POWER OF ATTORNEY 

As a below named inventor I hereby declare that: my residence, post office address and citizenship are as 
stated below next to my name; that 

I verily believe I am the original, first and joint inventor of the subject matter which is claimed and for which 
a patent is sought on the invention entitled: HYPERVIDEO TRACKING AND REPORTING SYSTEM . 

The specification of which is attached hereto. 

I hereby state that I have reviewed and understand the contents of the above-identified specification, 
including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to the patentability of this application in 
accordance with 37 C.F.R. § 1.56 (attached hereto). I also acknowledge my duty to disclose all information known 
to hSmaterial to patentability which became available between a filing date of a prior application and the national or 
PCTjnternational filing date in the event this is a Continuation-In-Part application in accordance with 37 C.F.R. 
§l.fB(e). 

j 5 I hereby claim foreign priority benefits under 35 U.S.C. §1 19(a)-(d) or 365(b). of any foreign application(s) 
for pitent or inventor's certificate, or 365(a) of any PCT international application which designated at least one 
couiMry other than the United States of America, listed below and have also identified below any foreign application 
for patent or inventor's certificate having a filing date before that of the application on the basis of which priority is 
claimed: 

No sf&ch claim for priority is being made at this time. 

I hereby claim the benefit under 35 U.S.C. § 1 19(e) of any United States provisional application(s) listed 

beldW: 

A pplication Number Filing Date 

60/167,165 November 23, 1999 

I hereby claim the benefit under 35 U.S.C. § 120 or 365(c) of any United States and PCT international 
application(s) listed below and, insofar as the subject matter of each of the claims of this application is not disclosed 
in the prior United States or PCT international application in the manner provided by the first paragraph of 35 U.S.C. 
§ 1 12, 1 acknowledge the duty to disclose material information as defined in 37 C.F.R. § 1.56(a) which became 
available between the filing date of the prior application and the national or PCT international filing date of this 
application: 



No such claim for priority is being made at this time. 
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I hereby appoint the following attorney(s) and/or patent agent(s) to prosecute this application and to transact 
all business in the Patent and Trademark Office connected herewith: 



Anglin, J. Michael 


Reg. No. 


24,916 


Hill, Stanley K. 


Reg. 


No. 


37,548 


Nelson, Albin J. 


Reg. 


No 


28,650 


Beekman, Marvin L. 


Reg. No. 


38,377 


Huebsch, Joseph C. 


Reg. 


No. 


42,673 


Nielsen, Walter W. 


Reg. 


No. 


25,539 


Bianchi, Timothy E. 


Reg. No. 


39,610 


Jurkovich, Patti J. 


Reg. 


No. 


44,813 


Oh, Allen J. 


Reg. 


No. 


42,047 


Billion, Richard E. 


Reg. No. 


32,836 


Kalis, Janal M. 


Reg. 


No. 


37,650 


Padys, Danny J. 


Reg. 


No. 


35,635 


Black, David W. 


Reg. No. 


42,331 


Kaufmann, John D. 


Reg. 


No. 


24,017 


Parker, J. Kevin 


Reg. 


No. 


33,024 


Brennan, Leoniede M. 


Reg. No. 


35,832 


Klima-Silberg, Catherine I. 


Reg. 


No. 


40,052 


Perdok, Monique M. 


Reg. 


No. 


42,989 


Brerman, Thomas F. 


Reg. No. 


35,075 


Kluth, Daniel J. 


Reg. 


No. 


32,146 


Prout, William F. 


Reg. 


No. 


33,995 


Brooks, Edward J., Ill 


Reg. No. 


40,925 


Lacy, Rodney L. 


Reg. 


No. 


41,136 


Schumm, Sherry W. 


Reg. 


No. 


39,422 


Chu, Dinh CP. 


Reg. No. 


41,676 


Lemaire, Charles A. 


Reg. 


No. 


36,198 


Schwegman, Micheal L. 


Reg- 


No. 


25,816 


Clark, Barbara J. 


Reg. No. 


38,107 


LeMoine, Dana B. 


Reg. 


No. 


40,062 


Scott, John C. 


Reg. 


No. 


38,613 


Clise, Timothy B. 


Reg. No. 


40,957 


Lundberg, Steven W. 


Reg. 


No. 


30,568 


Smith, Michael G. 


Reg. 


No. 


45,368 


Dahl, John M. 


Reg. No. 


44,639 


Maeyaert, Paul L. 


Reg. 


No. 


40,076 


Speier, Gary J. 


Reg. 


No. 


45,458 


Drake, Eduardo E. 


Reg. No. 


40,594 


Maki, Peter C. 


Reg. 


No. 


42,832 


StefTey, Charles E. 


Reg. 


No. 


25,179 


Embretson, Janet E. 


Reg. No. 


39,665 


Malen, Peter L. 


Reg. 


No. 


44,894 


Terry, Kathleen R. 


Reg. 


No. 


31,884 


Fordenbacher, Paul J 


Reg. No. 


42,546 


Mates, Robert E. 


Reg. 


No. 


35,271 


Tong, Viet V. 


Reg. 


No. 


45,416 


Forrest, Bradley A. 


Reg. No. 


30,837 


McCrackin, Ann M. 


Reg. 


No. 


42,858 


Viksnms, Ann S. 


Reg. 


No. 


37,748 


Gampn,. Owen J. 


Reg. No. 


36,143 


Moore, Charles L., Jr. 


Reg. 


No. 


33,742 


Vogel, Peter J. 


Reg 


No. 


41,363 


Harris^kobert J. 


Reg. No. 


37,346 


Nama, Kash 


Reg. 


No. 


44,255 


Woessner, Warren D. 


Reg. 


No. 


30,440 



■: %l I hereby authorize them to act and rely on instructions from and communicate directly with the person/assignee/attorney/ 
fmn/Sganization/who/which first sends/sent this case to them and by whom/which I hereby declare that I have consented after full 
disclosure to be represented unless/until I instruct Schwegman, Lundberg, Woessner & Kluth, P.A. to the contrary. 

Pleasgdirect all correspondence in this case to Schwegman, Lundberg, Woessner & Kluth, P.A. at the address indicated below: 
7i P.O. Box 2938, Minneapolis, MN 55402 

; ? Telephone No. (612)373-6900 



; : I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and 
beliefare believed to be true; and further that these statements were made with the knowledge that willful false statements and the like so 
made;Nbe punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued thereon. 

Full Same of joint inventor number 1 : Yossi A. Hermush 

Citizenship: Israel Residence: Tel-Aviv, Israel 

Post Office Address: 8 Shderot Hazionut 

Tel- Aviv 62157 
Israel 

Signature: Date: 

Yossi A. Hermush 



Full Name of joint inventor number 2 : Rottem Keret 

Citizenship: Israel Residence: Shchenia 20142, Israel 

Post Office Address: 1 20 Shchenia 

Shchenia 20142 
Israel 

Signature : — Date : 

Rottem Keret 



X Additional inventors are being named on separately numbered sheets, attached hereto. 
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I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and 
belief are believed to be true; and further that these statements were made with the knowledge that willful false statements and the like so 
made are punishable by fine or imprisonment, or both, under Section 1 00 1 of Title 1 8 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued thereon. 

Full Name of joint inventor number 3 : Shmuel Weller 

Citizenship: Israel Residence: Tel Aviv, Israel 

Post Office Address: 21 Shalom Ash Street 

Tel Aviv 62517 

Israel 

Signature: Date: „ 

Shmuel Weller 



Full Name of joint inventor number 4 : Dror Harel 

Citizenship: Israel 

Post ©pice Address: Hadafiia 29 St. 

S Zoran 

: " Israel 



Residence: Zoran, Israel 



Sign&Hire: 



Dror Harel 



Date: 



Full Name of inventor: 
Citizenship: 
PostiOfflce Address: 



Residence: 



Signature: 



Date: 



Full Name of inventor: 

Citizenship: Residence: 
Post Office Address: 



Signature: 



Date: 
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(a) A patent by its very nature is affected with a public interest. The public interest is best served, and the most effective patent 
examination occurs when, at the time an application is being examined, the Office is aware of and evaluates the teachings of all information 
material to patentability. Each individual associated with the filing and prosecution of a patent application has a duty of candor and good 
faith in dealing with the Office, which includes a duty to disclose to the Office all information known to that individual to be material to 
patentability as defined in this section. The duty to disclose information exists with respect to each pending claim until the claim is canceled 
or withdrawn from consideration, or the application becomes abandoned. Information material to the patentability of a claim that is 
canceled or withdrawn from consideration need not be submitted if the information is not material to the patentability of any claim 
remaining under consideration in the application. There is no duty to submit information which is not material to the patentability of any 
existing claim. The duty to disclose all information known to be material to patentability is deemed to be satisfied if all information known 
to be material to patentability of any claim issued in a patent was cited by the Office or submitted to the Office in the manner prescribed by 
§§1 .97(b)-(d) and 1 ,98. However, no patent will be granted on an application in connection with which fraud on the Office was practiced 
or attempted or the duty of disclosure was violated through bad faith or intentional misconduct. The Office encourages applicants to 
carefully examine: 

(1) prior art cited in search reports of a foreign patent office in a counterpart application, and 

u3 (2) the closest information over which individuals associated with the filing or prosecution of a patent application believe any 
y pending claim patentably defines, to make sure that any material information contained therein is disclosed to the Office. 

: V. u 

(b) iL Under this section, information is material to patentability when it is not cumulative to information already of record or being 
made^f record in the application, and 

*~ s (1) It establishes, by itself or in combination with other information, a prima facie case of unpatentability of a claim; or 

(2) It refutes, or is inconsistent with, a position the applicant takes in: 

^ (i) Opposing an argument of unpatentability relied on by the Office, or 

y (ii) Asserting an argument of patentability. 

A prima facie case of unpatentability is established when the information compels a conclusion that a claim is unpatentable under the 
preponderance of evidence, burden-of-proof standard, giving each term in the claim its broadest reasonable construction consistent with the 
specification, and before any consideration is given to evidence which may be submitted in an attempt to establish a contrary conclusion of 
patentability. 

(c) Individuals associated with the filing or prosecution of a patent application within the meaning of this section are: 

( 1 ) Each inventor named in the application: 

(2) Each attorney or agent who prepares or prosecutes the application; and 

(3) Every other person who is substantively involved in the preparation or prosecution of the application and who is 
associated with the inventor, with the assignee or with anyone to whom there is an obligation to assign the application. 



(d) Individuals other than the attorney, agent or inventor may comply with this section by disclosing information to the attorney, 
agent, or inventor. 



